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ABSTRACT 


The purpose of this thesis is to investigate the effects of four different types of 
scout vehicles when performing a zone reconnaissance as part of a battalion movement-to- 
contact. The four different types are the current HMMWV (Highly Mobile Multi-Purpose 
Wheeled Vehicle), and three variants of the future scout vehicle (heavy, moderate, and 
light). The analysis used the Janus(A) High Resolution Combat Model with a southwest 
Asia scenario. Operators at Fort Knox, KY and at the Naval Postgraduate School 
conducted the simuiation. Six measures of effectiveness (MOEs) were used in the study. 
To detect any significant differences between the vehicles each alternative was compared 
using Scheffé’s and Tukey's Methods of Multiple Comparisons. The Hierarchical 
Additive Weighting Method was used to rank the alternatives to determine the best vehicle 
suited for conducting this specific mission. The results from the data collected from both 
sets of operators indicate that the heavy variant of the FSV is the best vehicle for the zone 


reconnaissance mission. 
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EXECUTIVE SUMMARY 


The scout platoon at the battalion level currently consists of ten HMMWYVs 
(Highly Mobile, Multi-purpose, Wheeled Vehicles). This platoon does not have the 
capabilities to conduct security and reconnaissance missions into the next century By ihe 
year 2010, the Army needs a vehicle that incorporates emerging technology and can 
successfully conduct all missions of the scout platoon. By using computer simulation one 
can analyze different vehicle characteristics for the scout platoon ta determine the best 
vehicle suited for the scout piatoon missions. 

The Janus(A) High Resolution Combat Model was chosen as the computer 
simulation model because of its ability to provide details down to the individual vehicles 
The initial step in the analysis was to design a computer scenario that would aid in the 
process of selecting the best alternative for the scout platoon. Because of the continued 
tension with Iraq, southwest Asia was chosen as ihe terrain cn which to do the 
simulation = An Iraqi battalion, conducting a mecting engagement. was the enemy 
encountered Ina desert scenario, conducting a zone reconnaissance as part of a battalion 
Movement-to-contact is one of the important missions of the scout platoon, so this was 
the mission analyzed. Six measures of effectiveness were used to quantity the results 
obtained from running the computer simulation 

The second step in the analysis was to determine if any significant: differences 
existed between the HMMWY platoon and the combined results of the future scout 
vehicle Scheffé's Method of Multiple Comparisons was used to compare the average of 
the results irom the three variants of the future scout vehicle against the results collected 
from the HMMWY platoon This analysis demonstrated that significant differences did 
exist between the platoons 

Once significant differences were detected with the initial comparison. the third 
step in the analysts was to conduct comparsons among the four distinct platoons 


Tub cy's Method of Multiple Comparisons was used to determine if significant differences 


xi 





existed between the platoons. This method revealed the differences between the platoons 
but could not quantify the results to lead to the selection of the best alternative for 
configuring the scout platoon. The final step in the analysis was to use the results from 
Tukey’s method to quantify the results. The Hierarchical Additive Weighting Method was 
the tooi used to accomplish this quantification. The existence or nonexistence of 
significant differences were used as inputs into the weighting method in order to rank the 
alternatives. When analyzed using these specific parameters, the data collected from both 
sets of operators indicated that the heavy variant of the future scout vehicle is the best 


configuration of the scout platoon. 








], INTRODUCTIGN 


The Commander must be able to see the baitlefieid. The first step in 
winning is seeing the battlefield, If the commander can't see the 
hattlefield - before and during the battle - the day, the battle, maybe even 
the war is lost. [Ref /| 


A. OVERVIEW 


To win on the battlefield, the heavy armor battalion commander must synchronize 
all of his combat multipliers to focus combat power at the decisive time and place. Two 
important considerations for commanders are that of reconnaissance and security. 
Accurate reconnaissance and security operations provide the commander the necessary 
information to mass his force and exploit the enemy’s weaknesses. Reconnaissance 
success is a nv. *s*>7¥ pre-condition fo: mission succzss. The scout platoon is organized, 
equipped, and trained to conduct reconnaissance and security for the battalion-sized unit. 
The scout platoon serves as the commander’s eyes and ears on the battlefield. It provides 
current battlefield information to help the commander plan and conduct tactical 
operations. As technology changes, the scout platoon must also maintain its capability 
and effectiveness, thus giving the commander the most reliable information on which to 
make his decisions. The primary missions of the scout platoon are: 

e Reconnaissance. 

© Screening in support of its parent unit. (Ref. 2] 

Reconnaissance ‘failures, throughout history, have contributed directly to many 
military failures. The battles of Gettysburg, Midway, Remagen, and Sontay. Vietnam are 
all examples of reconnyissance failures. RAND data collected at the National Training 
Center indicate that 90% of all successful missions are characterized by successful 
reconnaissance, while in cnly 15% of all examined missions was successful 
reconnaissance not accompanied by mission success. [Ref 3] Inherent in the continued 
success of reconnaissance is a vehicle that will be able to perform into the 2) st century A 


reasonable approach is to study different configurations of the scout vehicle and to 





determine which combination of characteristics 1s best for accomplishing the scout platoon 
missions. The effects of these different characteristics may be studied when implemented 
into the Janus(A) combat model used for analysis. After the simulation is run, pairwise 
comparisons will be done on each scout platoon alternative to determine the superior type 


of vehicle fur accomplishing the mission. 


B. BACKGROUND 


The Army has recognized the need for a new scout vehicle. The foilowing 


conclusions were drawn from the Army Modernization Plan: 


Current scout vehicles cannot adequately collect threat information, 

locate targets, synchronize fire beyond line-of-sight, perform security 

mussions, identify targets during periods of limited/obscured vision and 

identify air/ground targets beyond visual range ... and integrate information 

for battiefield decision-making. (Ref. 4} 

The Army has recognized these deficiencies and in the near and mid term has 
devised a strategy for improving current vehicles. In the far term (FYO! and beyond) the 
Army wants a different vehicle that employs maturing technologies. This vehicle needs to 
be a highly mobile platform incorporating stealth technology, advanced vehicle electronics 
and communications, and integrated defensive measures for high survivability. The Future 
Scout Vehicle (FSV) must operate throughout the battlefield and use an integrated 
day/night, all-weather surveillance and target acquisition system to locate high priority 
targets. The FSV also has a direct fire weapon capable of defeating light armer, and 
performs the full range of ground reconnaissance and security missions as well as economy 


of force operations. (Ref. 4: p. A-42] 


G NATURE AND ROLE OF JANUS(A) 


JANUS(A) is a high resolution model used for combat analysis The model is an 
interactive, two-sided, closed, stochastic ground combat simulation. Interactive refers to 


the interplay between players who decide what to do in crucial situations dusing simulated 


combat and the systems which model that combat. Two-sided refer to the two opposing 


2 





forces directed simultaneously by two sets of players. Closed means that the disposition 
of opposing forces is largely unknown to the players in control of the other force. 

tochastic refers to the way the system determines the results of actions such as direct fire 
engagements, according to the laws of probability. Ground combat means that the 
principal focus is on ground maneuver and artillery units. [Ref. 5] 

The JANUS data base describes systems extensively and in great detail. Individual 
fighting systems have distinct properties: dimensions, weight, carrying capacity, speed, 
weapons, and weapons capabilities such as range, type of ordnance, and other processes 
that influence combat outcomes. 

In TANUS, the simulation entities are individual combat vehicles or weapon 
systems giving the analyst the ability to observe and modify the parameters of individual 
combat processes. Thee modifications will generate observations to use in the analysis. 

The simulation used digitized terrain developed by the Defense Mapping Agency, 
displaying it ‘n a form familiar to the military, using contour lines, roads, rivers, 
vegetation, and urban areas. Digitized terrain features realistically affect visibility and 
movement. 

A feature called AUTOJAN vermits playback or replay of a previously executed 
Janus scenario rua. during the onginal scenr-io run, all manual actions made by the users 
are saved. When the scenario is replayed in AUTOJAN mode, the user can specify thet 


ane or more of the workstations assigned to the ariginal scenark. run retrieve thei: manual 


actions from the recording flie rather than new user input. 
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Il. MODEL METHODOLOGY 


If 1 am able to determine the enemy's disposition while | at the same lime 
conceal my own, then I can concentrate and he must divide ... and I can 
use my entire strength to attack a fraction of his. [Ref. 6] 


A. SCOUT PLATOON MISSION 


The scout platoon, as part of a. battalion-sized unit, must perform numerous 
primary and secondary missions, to include: route reconnaissance, zone reconnaissance, 
area reconnaissance, screen, guard, and cover. The zone reconnaissance is one mission 
that the platoon must perform extensively in the desert scenario. Scouts conduct zone 
reconnaissance missions for their parent unit to provide early warning of enemy approach 
and to provide real-time information, reaction time, and maneuver space for the main 
body. A commander calls on scouts to conduct the zone reconnaissance for him when he 
needs advance warning of when and where the enemy is attacking. Operating over an 
extended area, the platoon fights only for self-protection and remains within its 
capabilities. It denies enemy reconnaissance units close-in observation of the main body. 
In this model, the scout platoon conducts a zone reconnaissance for a balanced task force 
conducting a movement-to-contact. As currently configured, the vehicles in the scout 
platoon cannot effectively conduct a zone reconnaissance. The problem is to determine 
what type of vehicle is best suited for accomplishing this specific mission within the 


guidelines ofa battalion movement-to-contact. 
| B. JANUS(A) TACTICAL SCENARIO 
I. U.S. Forces 
a. Mission 


The mission of the U.S. force is to conduct a mevement-to-contact against 


an Iraqi force in southwest Asia. A movement-to-contact is an Gperation conducted to 


gain or reestablish contact with the enemy. Its purpose is the early development of the 





situation to provide an advantage prior to decisive engagement. A reconnaissance force 
precedes the main body to give it the necessary time to develop the situation. It is 


characterized by decentralized control and rapid commitment of forces from the march. 


b. Disposition of forces 


The scout platoon is conducting the zone reconnaissance mission for a 
balanced task force. The task force consists of two armor companies of 14 tanks (M1A2) 
each and two mechanized infantry companies of 14 infantry fighting vehicles (M2A2) 
each. The indirect fire support consists of the organic 120mm mortar platoon, a 155mm 
self-propelled artillery battalion, and one section of MLRS (Multiple, Launched, Rocket 
System). 


2; Iraqi forces 


a Mission 


The Iraqi force will be conducting a meeting engagement. The general 
principals followed by Iraqi forces in meeting engagements include: 
® Avoiding enemy strong points 


* Rapid maneuver 
e Movement to the enemy rear [Ref. 7] 


b. Disposition of forces 


The forces that the scout platoon and the task force will be encountering 
are in the advance party of an advance guard of a division column. The main combat 
vehicles in this size unit are 26 tanks (172), 13 infantry fighting vehicles (BMP-2), and a 
1S2mm artillery battalion in direct support. Figure |, on the next page, shows the 


disposition of forces at the beginning of the scenario. 


Cc. SCOUT PLATOON CONFIGURATIONS 


Four different platoons will be studied. These platoons will be a base case, a 


future scout vehicle (light) version, a future scout vehicle (moderate) version, and a future 
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Figure 1. Movement-to-contact 


scout vehicle (heavy) version. For the analysis, different characteristics of the vehicles will 
varied in Janus(A) according to the projected capabilities. The seven major attributes are 


artillery ballistic protection, direct fire ballistic protection, countermeasures, signature 











factor, maximum land speed, sensors, and armament. Some characteristics of the FSV do 
not currently exist in Janus(A). Considering the projected capabilities for the FSV, a 
similar parameter from a vehicle that currently exists in the database will be used. For 
example, the heavy variant is projected to have a missile launcher system that exceeds the 
capability of the current system. To model this improved missile system, the attributes of a 
Hellfire missile system were used. The countermeasures for the FSV variants degrade the 
missile probability of hit by 25%. This figure is assumed true for this study based on 
conversations with the Analysis and Force Development Divisions at Fort Knox, KY. 
The attributes used for each vehicle are explained in detail in the following paragraphs and 


summarized in Table | on page !0. [Ref. 8] 
1. Base Case 


The base case scout platoon consists of the current ten Highly Mobile Multi- 
Purpose Wheeled Vehicles (HMMWV). The HMMWV is up-armored to account for 
changes to the outside of the vehicle currently being developed. For artillery ballistic 
protection, the platoon vehicles have the characteristics of the average between an 
armored personnel carrier and a light wheeled vehicle. For direct fire ballistic protection, 
the characteristics are that of an up-armored HMMWV. The HMMWV does not have 
any current countermeasures that would affect the enemy’s ability to engage it. {t has a 
signature factor of 1.8 meters. The signature is the term used ro describe the size of the 
vehicle that is presented to the enemy in the simulation. The signature takes into account 
the height, width, and length of the vehicle. The larger the signature, the easier it is for the 
enemy to detect and engage the vehicle. The maximum land speed for the HAMWYV is 
105 knvhr. The sensors used for identifying and classifying the enemy are the naked eye, 
7 X 50 binoculars, and a sight comparable to the MIAI thermal sight. Five HMMWVs of 


the platoon carry the 7.62mm machine-gun and a .50 caliber machine-gun, while the other 


five carry the 7.62mm machine-gun and the MK-19 grenade launcher. 





zs Future Scout Vehicle (light) 


The FSV (light) platoon consists of ten vehicles. Its primary mission is to be able 
to detect the enemy at extended ranges. This platoon does not have the capability to 
destroy anything greater than enemy wheeled vehicles. For artillery ballistic protection, 
the FSV (light) has the average value between an armored personnel carrier and a light 
wheeled vehicle. The direct fire ballistic protection is the same as that of the up-armored 
HMMWV. Because of the projected stealth capability of the future scout vehicle, it has 
by use of countermeasures, the ability to degrade the probability that it will be engaged by 
an enemy missile system by 25%. Its signature factor is 0.5 meters. The maximum speed 
for the FSV (light) is 110 km/hr. The sensors on the vehicle are 8 X 50 binoculars, a mast 
mounted thermal sight, and a Target Acquisition Designation System (TADS-TV). The 
TADS-TV consists of a Light Helicopter sight (LHX-TV) and an Air Defense Acquisition 


Tracking System (ADATS- TV). For its armament it only carries a 7.62mm machine-gun. 


3. Future Scout Vehicle (moderate) 


The FSV (moderate) platoon consists of ten vehicles. It is designed to detect the 
enemy at extended ranges and has the capability to destroy some light armored enemy 
vehicles For its artillery ballistic protection, it has the average value of the characteristics 
between an armored personnel carrier and a medium tracked vehicle. For its direct fire 
ballistic protection it has the characteristics equal to a M113 armored personne) carrier. 
The countermeasures are the same as the light version. Its signature factor is 0.8 meters. 
The maximum land speed for the FSV (moderate) is 95 knVhr. The sensors it carries are 8 
X 50 binoculars, a mast mounted thermal sight, and a TADS-TV. For its armament it has 


a 25mm chain gun and can dismount a soldier to fire the Javelin. 


4. Future Scout Vehicle (heavy) 


The FSV (heavy) platoon consists of ten vehicles. It is designed to detect the 


enemy at extended ranges and to defeat enemy armored vehicles. For its artillery ballistic 





protection, it has the average value of the characteristics between an armored personnel 
carrier and a medium tracked vehicle. For the direct fire ballistic protection is has the 
same characteristics as that of a M3 Bradley Fighting Vehicle. The countermeasures are 
the same as the light and moderate versions. Its signature factor is 1.2 meters. The 
maximum land speed for the FSV (heavy) is 89 km/hr. Its sensors are 8 X 50 binoculars, 
a mast mounted thermal sight, and a TADS-TV. Its armament consists of a 25mm chain 
gun, Javelin, and the Hellfire missile. The cifferent attributes for each platoon that are 


used in the Janus(A) database are summarized in Table |. 


Artillery Ballistic APC/Light APC/Ligh APC/Medium | APC/Medium 
Protection wheeled wheeled tracked tracked 
ence vehicle vehicle vehicle 


Direct Fire Ballistic MMWYV Up- | HMMWV Up- M113 M3A3 
Se eae amet armored 


| Countermeasures _| degrade missiles probability of hit by 25% 


Signature cess | __tane _ 
Factor 0.5 


.50 cal ; 25mm 25mm 
Armament 762mm Javelin Hellfire 
MK19 GL Javelin 
Eyes TADS-TV TADS-TV TADS-TV 
Sensors Binos (7x) Thermal Sight | Thermal Sight | Thermal Sight 
MI Thermal (Mast mtd) (Mast mtd) (Mast me) 
Binos (8x Binos (8x 





Land Speed (kph) 
Table 1. Scout Platoon Attributes 








Ili. ANALYSIS METHODOLOGY 


A. RUN MATRIX 


The HMMWV equipped platoon and the FSV variants will execute the movement- 
to-contact mission one time. Five more runs will be executed using the AUTOJAN mode. 
AUTOJAN uses the actions of the first man-in-the-loop run and produces similar actions 
and reactions based on a random seed. The six runs will be accomplished by operators at 
Fort Knox, Kentucky and at the Naval Postgraduate School, Monterey. There are a total 
of 6 repetitions per cell. Each run produces a direct fire report, detection report, and 
coroner’s report for analysis. The results from the summarized reports are included in 


Appendix A. 


B. OVERVIEW 


Initially, each location will be analyzed separately to determine the best alternative 
for the scout platoon configuration. First, Scheffé's multiple comparison test will be used 
first to determine the trends between the FSV variants, taken 7s a whole group, versus the 
HMMWV. Second, Tukey's multiple companson test will be used to determine if 
significant differences exist between all vehicle alternatives for each measure of 
effectiveness. The significant differences will then be used for input into the hierarchical 
additive weighting method to establish the best vehicle variant taking all measures of 


effectiveness into consideration. 


Cc. ESSENTIAL ELEMENTS OF ANALYSIS 


This study will concenirate on four essential elements of analysis to detect any 
discernible differences between the different variants of the scout vehicles The clements 


will be concerned with the scout platoon’s ability to accomplish the basic collective tasks 


necessary to perform a successful zone reconnaissance as part of a battalion 








1. Essential Elements of Analysis 1 


The first essential element of analysis is to determine how well is the platoon able 
to detect and report all enemy forces in its area of interest. An integral component of any 
scout mission is its ability to perform reconnaissance. The scout platoon must report 
quickly and accurately to the battalion commander so he can make the proper battlefield 
decisions. The two measures of effectiveness used to quantify the platoons will be: 

e The average range cf detections of Iraqi forces by U.S. scout platoon 

personnel in the first forty minutes of the battle. 


e The total number of detections of Iraqi forces by the U.S. scout platoon during 
the first forty minutes of the battle. 


The time element of forty minutes was used because that is when, during the 
simulation, the main body of the Iraqi force had closed to within engagement distance of 
the U.S. force. The scouts are able to have the greatest effect on the outcome of the 


battle during the initial lead-in to the main battle. 


2. Essential Elements of Anziysis 2 


The second element of analysis is to determine how wel! is the platoon able to 
survive while performing its mission The greater the number of vehicles that remain 
functional on the battlefield, the greater the capacity far the platoon to conduct all of its 
missions. The one measure of effectiveness used for the anaiysis is 

e =The number of U.S. scout platoon veiicles that survived at the completion of 

the battle 

The stopping criteiion for the completion of the battle was when the US forces 


had captured their objective At this time, a numerical count was taken of the remaining 


scout platoon vehicles. 





3. Essential Elements of Analysis 3 


The third essential element of analysis is to determine how well is the scout 
platoon able to perform surveillance without being detected. The scout platoon must be 
able to continually perfortit surveillance on the enemy without compromising its position 
Once its position is jeopardized, the commander does not know if the scout platoon is 
receiving accurate intelligence information or knowledge that the enemy wants him to 
receive The two measures of effectiveness used to quantify the platoons will be: 

e The average range that the U.S. scout platoon vehicles were detected by Iraqi 


forces. 
e The time difference of the first U.S. detection and the first Iraqi detection. 


These measures of effectiveness will demonstrate which platoons were able to give 
the commander the maximum time to process his available information before having to 


give an execution order to his maneuver forces. 


4, Essential Elements of Analysis 4 


The feurth essential element of analysis is to determine haw well is the unit able to 
repel and/or destroy enemy forces The one measure of effecuveness used for the analysis 
is. 

e =The number of Iraqi kills by U.S. scouts. 

When the simulation has reached the stopping criterion, a numerical count is taken 
on the number of Iragis that were killed by any weapon system on the scout platoon 
vehicles This MO& was used because some commanders believe it is important for the 


scouts to be able to kill the cnemy within its capability 


G. The ANALYSIS OF VARIANCE (ANOVA) MODEL 


The basic elements of the ANOVA imadel for a single-factor study are quite 


simple Corresponding to each factor level. there is a probability distribution of responses 
The ANOVA model assumes that 





@ Each of the probabiiity distributions is normal 

¢ Each probability distribution has the same variance 

¢ The observations for each factor level are random observations from the 

corresponding probability distribution and are independent of the observations 
for any other rfactor level [Ref 9]. 

In this study, the third assumption is supported by the nature of the simulation. 
Verifications are made on the first two. To determine if each of the probability 
distributions is normal, a normai probability plot of the residuals was constructed on some 
of the measures of effectiveness. This cursory analysis indicated a normal distribution 
with some departure: from normality, but as stated by Montgomery, “in general, 
moderate depart'-es from normality are of little concern in the fixed effects analysis of 
variance. Since the F test is only slightly affected, the analysis of variance (and related 
procedure: such as multiple comparisons) is robust to the normality assumption.” 
[Ref. 10] 

A separate test will be conducted to determine if each probability distribution has a 
common variance. The Hartley test will be employed to test for common variances. The 
test will be illustrated on a few of the measures of effectiveness, but performed on all the 


remaining measures. 


L. Hartley Test 


The Hartley test is based solely on the largest sample variance, denoted by max 


(s7), and the smallest variance, denoted by min(s7). The test statistic is: 


pe Sete) (1) 
min(s; } 


The appropriate decision rule for controlling the risk of making a Type | error at a is: 


ifH s H(1 - a. r, df), conclude H, that variances are equal 


IfH > HI - a; x, df), conclude H, that variances are unequal 





where H(1 - a; r, df} is the (i - a@)100 percentile of the distribution of H when H, holds, . 
‘or F populations and df degrees cf freedom for each variance [Ref. 9: p. 619]. In this case 
H(.95; 4, 5) = 13.7. This valte will be computed for two measures of effectiveness to 


illustrate that all measures of effectiveness satisfy the same variance assumption. 


1. Measure of Ljfectiveness 1 for Fort Knox Simulation 
0. 
TOC 115 
0.0253 


since [1.5 < 13.7, H, is concluded that all variances may be treated as equal. 


a Measure of Effectiveness 3 for NPS Simulation 


H= 1.3667 = 205 
0.6667 





since 2.05 < 13.7, H, ts concluded that all variances are assumed to be equal. A special 
consideration in usiag this test concerns the measure of effectiveness for the number of 
Iraqi kills for the scout platoon. In this case the variances for the HMMWV and FSV 
(light) platoons were zero because of the deterministic nature of the number of kills for 
these platoons. These platoons did not register a kill in twelve replications, and because 
cf the nature of the scenario and their armament will not register any kills in any future 
replications. Because of this situation, the test was only administered to the variances for 
the moderate anc heavy variants of the FSV The single factor ANOVAs for all the 


measures of effectiveness are included in Appendix B. 
H. =|. : ETHODS OF MULTIPLE COMPARISONS 


1. Scheifé’s method of multiple coniparisons 


Scheffée’s method of multiple comparisons is applicable for analysis of variance 
models. The Scheffe Method applies for analysis of variance models when the family of 


interest is the set of estimates of all possible contrasts among the factor level means A 


contrast. is a comparison involving two or more factor level means and includes the case 








of a pairwise difference between two factor level means. Here the method will be used to 
contrast the FSV family of vehicles with the HMMWYV ito determine if the FSV variants 
outperform the HMMWV in all cases. A contrast will be denoted by L, and is defined as a 
linear combination of the factor level means 4, : 

L=Zepu, where Ye =0 (2) 
The Scheffé method family confidence coefficient is exac:ly !- « whether the factor level 


sample sizes are equal or unequal.. An unbiased estimator of L is: 
4 — 
B= eV (3) 
al 


for which the estimated variance is: 


(4) 





and the probability is |- @ that all confidence limits of the type: 


B= 1+k{[S,] (5) 


are correct simultaneously, where K is given by: 


K = v(r = aL ~ are da - r| (6) 


where r is the number of different types of vehicles, n, is the total number of observations, 
and L is the difference of the means [Ref 10: p. 72]. Thus if we were to calculate the 
confidence intervals for all conceivable contrasts then in (1- a)100 percent of repetitions 
of the experiment, the entire set of confidence intervals in the family would be correct. If 
the confidence interval contains zero then the compared vehicles are not significantly 
different. In the case of general contcasis the Scheffé method tends to give narrower 
confidence limits and is therefore the preferred method. When only pairwise comparisons 


are tc -e made, the Tukey multiple comparison procedure gives narrower confidence 


limits and is therefore the preferred method. 





2 Tukey’s method of multiple comparisons 


The Tukey method of multiple comparisons considered here applies when the 
family of interest is the set of all pairwise comparison of factor level means. The Tukey 
method utilizes the studentized range distribution. The procedure requires the use of 
qu (a, f) to determine the critical value for all pairwise comparisons, regardless of how 
many means are in the group. Thus, Tukey’s test declares two means significantly 


different if the absolute vale of their sample differences exceeds 


7, = 4a(af)S, (7) 


where qa(a, f) is the studentized range statistic, and J, is defined as 


‘= : (8) 





where MS; is the mean squared error of the residual and » is the number of replications 
{Ref 10: p. 78]. Ifthe difference of the means of the compared vehicles ts less than the T,, 
value than the two vehicles are not considered significantly different. In this analysis, 
Tukey's meinod will be used to compare each vehicle with every other vehicle. The 
results from Tukey’s test will then be used in the hierarchical additive weighting method 


(HAWM) to determine the ranking of the scout platoon vehicle alternatives. 











IV. RESULTS 


A. SCHEFFE’S METHOD OF MULTIPLE COMPARISONS 
I. Fort Knox simulation runs 


For the average range of U.S. detections the analysis yielded 


1 573461646295 4. og, 
3 
(3) +) +G) eer 
S,,= [01359 - = 0.1738 


K = J3F{.95,3,20] = ./3(310) = 30496 

B= 061 + (3.0496){0.1738) = 0.61+0.53 
Using an a= 0.05, the confidence interval does not contain zero, so there is not a 
significant difference between the FSV family of vehicles and che HMMWV for this 
measure. Appendix C contains the computations of Scheffé's method for all the measures 


of effectiveness. The results for the MOEs are summarized in ‘Table 2 below. 


| Confidence Interval Significant) 

Average range of U.S. detections 0.61+0.53 Yes 2 
H 

q 

; | 



















Total # detected by U.S. scouts 26.23 + 20.19 


U.S. scout survivors §.61 42.39 











| Avg range of det. of U.S. scouts 0.41 + 0.69 





Time difference of first detections 3.60 + 4.46 






# of kills by U.S. scouts 6.33 + 1.80 


Table 2. Scheffe's Method for Fort Knox 











The FSV variants outperformed the HMMWV in four of the measures of effectiveness If 
all the MOEs are given the same degree of consideration for determining the best 
alternatives between the two choices, then the FSV variants are clearly the better type of 
vehicle. There were no discernible differences in the measures of the average range of 
detection by the Iraqi’s of the U.S. scouts, or the time difference of the first detections. 
One would expect the FSV variants to be superior in the number of Iraqi kills because of 
the high degree of armament that exists on the heavy variant. The results do show that the 
FSV variants do detect the enemy, on the average, from a farther distance and they can 


monitor the enemy's actions more closely, as seen by the total number of detections. 
re Naval Postgraduate School simulation runs 


The results fer the simulation runs made by the Naval Postgraduate School 


operators are summarized below in Table 3. 
| Average range of U.S. detections 0.42 £0.53 No 
| Total # detected by U.S. scouts 37.17 411.79 


Yes 

U.S. scout survivors 3.50 + 1.42 pes 
No : 
Yes 


Table 3. Scheffé's Method for NPS 




























0.11 £0.33 


3.79 + 3.7 


10.61 + 3.79 


| Avg range of det. of U.S. scouts 






Time difference of first detections 


# of kills by U.S. scouts 





in these simulation runs the FSV variants outperformed the HMMWV in four of 
the measures of effectiveness. In this case the four measures were not the same as seen 
from the Fort Knox operators. There were no discernible differences in the average range 
of detection by the U.S. scouts or in the average range of detection by the Iraqis of the 


U.S. scouts. The latter measure of effectiveness was the same for both sets of operators. 
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The data collected from the NPS operators indicated significance in the time difference of 
first detections. This contrast could be attributed to the difference in the execution of U.S. 
doctrine between themselves and the Fort Knox operators. The FSV variants did, <5 
expected, outperform the HMMWV in the number of Iraqi kills. When all six MOEs are 
analyzed together, the FSV variant is the better alternative for conducting a zone 
reconnaissance as part of a battalion movement-to-contact. Since the FSV variants did 


outperform the HMMWY\V, the next step in the analysis is to rank the alternatives. 


B. TUKEY’S METHOD OF MULTIPLE COMPARISONS 
1. Fort Knox simulation runs 


The following results were obtained for the measure of effectiveness of the average 


range of detections: 


qus(4,20) = 3.96 


S, = joss = 0.1505 
6 


Tos = (3.96)(0.1505) = 0.5960 
| HMMWV VV | Light | Light | Heavy | "Moderate 

















"Vehicle 
Avg. range of detection 


where the lines serve as a schematic that represents the difference of the means that are 
less than the Tus value. These lines represent the results that are not significantly different 
trom each other. For example, in the first MOE, the lines are under the pairs HMMWV- 
light, light - heavy, light moderate, and heavy - moderate, indicating no signiticant 


difference between these pairs of vehicles. Appendix D contains the comparisons for all 


2| 





1 
t 
' 


the measures of effectiveness. Table 4, on the next page, summarizes the relationship of . 
the vehicle configurations for all the MOEs. If Tukey’s method did not find a significant 
difference then NO was entered into the table while a YES was entered for a significant 


difference. 


HMMWV 





2. Naval Postgraduate School simulation runs 


The results from the simulation runs made by the Naval Postgraduate School 


Operators are summarized in Table 5 on the following page. 








So a or aye eee OPUS dae 


Light Moderate Hea 


| 


Moderate 


HMMWV 


it 
|___Moderate__| 
| ! 
|__HMMWV_| 
[Moderate 


Table 5. Tukey's Method for NPS 











C, HIERARCHICAL ADDITIVE WEIGHTING METHOD (HAWM) 
I. Fort Knox simulation runs 


Tukey’s method enabled comparison between vehicles based on the individual 
MOEs. The hierarchical additive weighting method (HAWM) was employed in order to 
provide a structured approach for organizing the problem data to determine the best 
vehicle. The first step in establishing the priorities of elements in this problem is to make 
pairwise comparisons of the elements against the MOEs. The pairwise comparisons are 
best displayed in a matrix. The matrix is a tool that offers a framework for making all 
possible comparisons, and analyzing the sensitivity of overall priorities to changes in 
judgment. The matrix approach reflects the dua! aspects of priorities: dominating and 


dominated. 


To begin the pairwise comparison process, start at the top of the hierarchy to 
select the measure of effectiveness that will be used for making the first comparison. Then 
from the level immediately below, take the vehicle alternatives to be compared. To fill in 
the matrix of pairwise comparisons, numbers are used to represent the relative importance 
of one alternative over another with respect to the measure of effectiveness. Values range 
from one {equal importance) through nine (extreme importance). Table 6, on the next 
page, summarizes the pairwise comparison scale. [Ref 11] The numerically translated 
Judgmenis are approximations, and are entirely based on the experience and real-life 


application of the system by the one assigning the relative importance. 


When comparing one element in a matrix with itself, the comparison must give 
unity. Always compare the first element of a pair (the element in the left-hand column of 
the matrix) with the second (the element in the row on top) and estimate the numerical 
value from the scale in Table 6. The reciprocal value is then used for the comparison of 


the second element with the first. 


After filling in the matrix, judgments must be synthesized to get an overall estimate 


of the relative priorities of the vehicles in relation to the measure of effectiveness. To do 
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equally to the propert 

3 Moderate importance of one | Experience and judgment 
over another slightly favor one element 
over another 
Experience and judgment 
strongly favor one element 
over another 
An element is strongly favored 
and its dominance is 
demonstrated in practice 
The evidence favoring one 
element over another is of the 
highest possible order of 
Laffirmation 

































Essential or strong importance 





Very strong importance 












Extreme importance 


Table 6. The Pairwise Comparison Scale 
so, add the values in each column and then divide each entry in each column by the total of 
that column to obtain the normalized matnix. This permits meaningful comparisons among 
’ the vehicles. Finally , the rows are averaged by adding the values in each row of the 


normalized matrix and dividing the rows by the number of entries. 


If Tukey’s method discerned a significant difference between vehicles, then a value 
of five (strong importance) was assigned to the vehicle comparison matrix, otherwise a 
value of one was assigned. Initially, the value of five was chosen because it lies in the 
middle of the range of values. Appendix E contains the pairwise comparison matrix for all 
the measures of effectiveness. Table 7 illustrates the pairwise comparison matrix for the 


first measure of eftectiveness for the Fort Knox operators. 


Light | Moderate | Heavy | 
HMMWY Le Se 


Light 


Moderate : 
! | 


Table 7. Example of Pairwise Comparison Using MOE | 
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Table 8 shows the normalized matrix for the first measure of effeciiveness for 


obtaining the priority values. 






ra: imn-ra-eermergens mmmrareremmemn meme —— 


TCT Tigi Moderate] Heawy [Prony] 
Haw [0.083 [0.25 | 00625 | 0.005 [0.1145 | 
[Light —[~0.083[ 0.25 | 03135 | 03125] ; 
[Moderate 
| ai? [0.25 0312s | 03195 | 03230 _| 









ee een Seee een seenie ne a nae 


Table 8. Normalized Matrix for MOE 1 
The next step was to determine the relative impoitance among all the measures of 
effectiveness. Using military judgment, the MOEs fell into two groups, MOEs | through 
3 and MOEs 4 through 6, with MOEs in each group having equal importance. The first 
group contained the slightly more critical criteria and was assigned a value of three: Weak 


importance when compared to the other group of MOEs (Table 9). 





wf Of Priority 


4 0:250 
| 


Poerneererreerrtrtrrntten tt 
0.250 
see 
RECT RARE PDUEDTRERETRRRRERERRZ Eas PAL UEN  Rheed ted  REE 


{0250 
Table 9. Normalized MOE Matrix 


a | Oa 





~ [0,083 
0.083 
0.083 





The final step is the combining of the priority values of the vehicles within each 
MOE and the prionty values among the MOEs to determine the best alternative. The final 
prionty score is obtained by multiplying MOE priority by the priority of the vehicle with 
respect to the MOE and summing across the rows The highest score represents the 


proferred vehicle. Table 10, on the next page, displays the final results 


For the Fort Knox operators the heavy variant was ranked the best alternative 


followed, in order. by the light version, the moderate, and finally the HMMWV 
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Additional analysis was conducted on the sensitivity of the values assigned in the pairwise . 
comparison matrix. Use of the values of three, seven, and nine did not change the 


conclusion of chioosing the heavy variant over the other alternatives. Also, because 


fm 
i 
i 
H 
fi 
i 


eth ht th ed) 





3125 [0.3981 0.62: 
Table 10. Combined Priorities 

of the dominance in firepower for the heavy variant, in the measure of effectiveness for the 
number of kills, the rankings were redone with this measure deleted. Once again, the 
heavy variant was the preferred alternative Changing the values of the relative 


importance between the two groups of the measures of effectiveness did not affect 


choosing the heavy variant as the alternative for the scout platoon vehicle. 
2. Naval Postgraduate School simuiation runs 


Table |i displays the priority matrix from the data produced by the NPS 


operators. 













ee a a TS |] Priority 
Ponty | 0.25 | 0.25 | 0.25 | 0.083 | 0.083 | 0083 
HMMWV | 0172 | 0.0625 | 0.059 | 0.234 | 0083 | 0.081 
| Light | 0.234 | 0.3125 | 0434 | 0172 | Oo82 | Gog! | 0274 - 
Moderate | 0.234 | 0.3125 | 0.212 | 0.234 | 0417 | 0279 | 0.267. 
_ Heavy | 0.359 | 0.3125 { 0.295 | @ 360 | 0417 | 0560 | 


Table U1. Combined Priorities 
Far the NPS operators the heavy variant was ranked the best alternative followed, in 
order, by the hight version, the moderate, and finally the HMMWV As in the Fort Knox 
case, adjusting the values in the pairwise comparison matnx did not change the final 
conclusion of choosing the heavy vanaat The only change noticed was when the groups 


of MOEs were weighted equally. In this case, the moderate version was ranked second 








with the light version ranking third and the HMMWV last. In ail cases, the heavy variant 


is the preferred alternative as the vehicle for the scout platoon. 
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V. CONCLUSIONS AND RECOMMENDATIONS 


A. CONCLUSION 


Using Scheffé’s method with the Fort Knox operators, the FSV variants, taken as 
a group, outperformed the HMMWV in the following MOFs: average range of US. 
detections, total number detected by U.S. scouts, the number of U.S. scout survivors, and 
the number of kills by U.S. scouts. There were no discernible differences in the following 
two MOEs: the average range of detection by the Iraqis cf the U.S. scouts, and the time 
difference of first detections. The analysis determined that the FSV variants were better in 
the number o7 kills by the U.S. scouts, but this was entizely due to the amount of kills 
registered by the heavy variant. Because of this fact one cannot conclude that ail the 
variants are better than the HMMWV platoon in this measure. Considering the analysis of 
the other five measures, the FSV variants outperformed the HMMWV and are a better 
vehicle suited for the zone reconnaissance mission. 

Using Scheffé’s method with the NPS operators, the FSV vartants outperformed 
the HMMWV in the following MOEs: the total number detected by the U.S. scouts, the 
number of U.S. scout survivors, the time difference of first detections, and the number of 
kills by the U.S. scouts. There were no discernible differences in the following two 
MOEs: the average range of detection by the U.S. scouts, and the average range of 
detection by the Iraqi’s of the U.S. scouts. The FSV variants did outperform the 
HMMWY in the number of kills by the U.S. scouts, but this was due to the amount of kills 
reuistered by the heavy vanant. Based on the analysis, though. of all the measures, the 
FSV variant did outperform the HMMWV in performing the tasks necessary to perform a 
zone reconnaissance. 

Based on Tukey's method, in conjunction with HAWM, the heavy variant appears 
to be the best alternative for the scout platoon configuration when it performs a zone 


reconnaissance as part of a battalion movement-to-contact. When the MOEs (the 








average range of U.S. detections, the total number detected by U.S. scouts, and the 
number of U.S. scout survivors) were weighted greater than the MOEs (the average range 
of detection by the Iraqi’s of the U.S. scouts, the time difference of first detections, and 
the number of kills by the U.S. scouts), the rankings were, in order, the heavy variant, the 
light variant, the moderate variant, and the HMMWV. Yhese rankings were consistent 
when computed with either the Fort Knox or NPS operators. 

When the measures of effectiveness were weighted equally the heavy variant was 
the best aiternative for both sets of operators. The rankings for the Fort Knox operators 
were the heavy variant, the light variant, the moderate variant, followed by the HMMWV. 
The rankings for the NPS operators were the heavy variant, the moderate variant, the light 
variant, followed by the HMMWV. Regardless of the operators the heavy variant was 


consistently the best alternative. 


B. RECOMMENDATIONS 


Given this mission of performing a zone reconnaissance as part of a battalion 
movement-to-contact, under these specific circumstances, the recommendation would be 
to configure the scout platoon with the heavy variant of the Future Scout Vehicle. The 
conclusion was reached by analyzing data produced by independent operators in two 
different locations: Fort Knox and the Naval Postgraduate School. 

The differences within the measures of effectiveness could be based on the use of 
distinct operators in both locations. The operators based the simulation runs on their own 
experience and background for interpretation of current U.S. doctrine. One extension of 
this study would be to run the sinwulation with a group of operators that are alike in 
experience level in conducting a battalion level movement-to-contact and then compare 
the results. 

In this study six measures of effectiveness, with varying degrees of importance, 
were used, The rankings of the importance of these measures were the views of the 
author in what is significant in conducting a zone reconnaissance. There exist numerous 


ways in assigning weights in the hierarchical additive weighted method. One could use the 
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methods described within this study to assign different weights to the measures of 
effectiveness based on different scout platoon missions or objectives. Thus, these methods 


could be used to determine the best scout platoon alternative for each mission. 
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APPENDIX A. MEASURES OF EFFECTIVENESS 





L— Fort Knox Simulation Runs 
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Time difference of first 
detections 


| # of kills by scouts | 
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NPS Simulation Runs | 
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APPENDIX C. SCHEFFE’S METHOD OF MULTIPLE COMPARISONS 


A. FORT KNOX SIMULATION RUNS 
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APPENDIX D. TUKEY’S METHOD OF MULTIPLE COMPARISONS 


A. FORT KNOX SIMULATIONS 
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where the lines represent the difference of the means that are less than the To; value. 


These tines represent the results that are not significantly different from each other. 
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B. NAVAL POSTGRADUATE SCHOOL SIMULATIONS 
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APPENDIX FE. HIERARCHICAL ADDITIVE WEIGHTING METHOD 


A. FORT KNOX SIMULATION RUNS 
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